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IMAGE Affm VIDEO AUTHENTIC ATIOIWf STEM 
BACKGROUND OF THE INVENTION 

5 Field of the Invention 

This invention generally relates to a system and method for authenticating 
image signals whether they are still images or part of motion picture video. A 
system designed according to this invention provides a digital signature unique to 
10 the image and embeds coded information corresponding to that signature into a 
transform representation of the image. 
Description of the Related Art 

Digital imaging is being used at an increasing rate. Two standards for 
handling compressed digital image information include JPEG, which is typically 
15 used for still images, and MPEG, which is typically used for motion picture video. 

The JPEG compression standard is described in "The JPEG Still Picture 
Compression Standard", by Gregory T. Wallace, Communications of the ACM, 
April 1991, vol. 34, No. 4, pp. 31-44, which is incorporated into this specification 
by reference. 

20 The MPEG standard is commonly used for motion picture video 

compression. MPEG is described in Practical Digital Video With Programming 
Examples In C, by Phillip E. Mattison, John Wiley and Sons, 1994, chapter 11, 
pages 373 through 393, and in "MPEG: A Video Compression Standard for Multi- 
Media Applications", by Didier Le Gall, Communications of the ACM, April 

25 1991, vol. 34, no. 4, pps. 47 through 58, all of which are incorporated into this 
specification by reference. 

As the use of digital imaging increases, the need for handling the image 
information in new ways also increases. One example is the need for image 
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authentication in MKmstances where the image inf Jfttion is used for 
surveillance or other situations where the integrity of a received image signal is 
critical. Whether image signals are captured and stored in memory for later 
observation or are transmitted over a network to a central location for real time 
5 observation, it is possible for unauthorized individuals to manipulate the stored 
images or to tamper with the signal being sent over the network. 

While some attempts have been made to provide enhanced handling of 
image information, none has addressed the need for a secure authentication 
system. For example, the published application GB 2,326,048 discusses a system 
10 for embedding a digital watermark into compressed image data. The digital 
watermark, however, merely indicates copyright or other author identification 
information. The disclosure of that document does not include sufficient security 
measures to authenticate the content of an image signal. 

Those skilled in the art have been endeavoring to develop new methods for 
15 ensuring the integrity of transmitted signals. One area where advances have been 
made is the derivation of a digital signature for an image based upon the image 
data. This invention utilizes a digital signature extraction method combined with 
embedding the digital signature information into a transform representation of the 
image. At a receiving location, the embedded information can be deciphered and 
20 compared with the expected image signature so that the integrity of the received " 
signal can be verified. 

SUMMARY OF THE INVENTION 

This invention is useful for authenticating an image signal whether that 
signal is a still image or part of a motion picture video signal. The invention is 
25 most useful with compressed signal formats and provides a coded signature 
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embedded into a trWRrm representation of the image tllBRorresponds to the 

content of the image so that the authenticity of the image can be verified. 

A system designed according to this invention is useful for authenticating 
an image signal. The system includes a transform module that generates a 
5 transform representation of the image. The transform representation includes high 
frequency coefficients. A signature extractor module generates a digital signature 
that is unique to the image because it is based upon the content of the image data. 
A signature embedding module assigns new values to the high frequency 
coefficients that correspond to the digital signature. In this way, a coded version 

10 of the digital signature is embedded into the transform representation of the image. 
The coded version of the digital signature can be deciphered at a receiving location 
and compared to the appropriate signature based upon the image data so that the 
authenticity of the received signal can be verified. 

Another aspect of this invention is a method of authenticating an imase 

15 signal that includes several basic steps. A transform representation of the image is 
generated. A digital signature unique to the image is determined, preferably by 
utilizing the image data information. The transform representation of the image 
includes high frequency coefficients that are identified. Then the high frequency 
coefficients are assigned new values that correspond to the digital signatures so 

20 that a coded version of the digital signature is embedded into the transform " 

representation of the image. 

Another aspect of this invention is to provide a computer readable medium 

having a plurality of computer executable instructions for authenticating an image 

signal. The computer readable medium designed according to this invention 

25 preferably includes a first program module that directs the computer to generate a 
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'transform representa^^ of the image. The transform rep^J^ntation preferably 
includes high frequency coefficients. A second program module directs the 
computer to determine a digital signature unique to the image, preferably based 
upon the image data content. A third program module directs the computer to 
5 assign new values to the high frequency coefficients in the transform 
representation. The values assigned to the high frequency coefficients correspond 
to the digital signature. The assigned values in the high frequency coefficients are 
a coded version of the digital signature embedded into the transform representation 
of the image, which can be deciphered at a receiving location and compared to the 
10 image signature to authenticate the received signal. 

The various features and advantages of this invention will become apparent 
to those skilled in the art from the following detailed description of the currently 
preferred embodiments. The drawings that accompany the detailed description can 
be briefly described as follows. 
15 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 schematically illustrates a system designed according to this 
invention. 

Figure 2 is a flow chart diagram illustrating a method of this invention. 

Figure 3 is a schematic illustration of a preferred method of embedding 

20 signature information into a transform representation of an image signal. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figure 1 schematically illustrates a system 20 for authenticating an image 

signal that is useful whether the image corresponds to a still photograph or is a 

portion of a motion picture video signal. Image data is provided from a data 

25 source 22. A transform module 24 processes the image data as part of a data 
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transform is utilized as known in the art. Different transform algorithms used as 
part of data compression schemes are known in the art. The transform module 24 
effectively generates a transform representation of the image. 



that determines a digital signature for the image. The digital signature preferably 
is based upon the content of the image data so that it is unique to the image. The 
currently preferred embodiment of this invention includes extracting an image 
signature by choosing a set of sub-images or windows from the image. The 

10 sub-images or windows can be samples of the image data such as JPEG blocks or 
multiple blocks, for example. Relationships between selected pairs of the windows 
or samples are then used to build a signature. 

For example, an image is divided into 32 windows, divided into 16 pairs. 
Where a 16-bit signature is desired, each pair is assigned to one of the bits in the 

15 signature. A value is computed for each pair of data samples. An evaluation 
function is applied to each window of the image to compute a representative value 
of that window. The representative values are then used in a comparison and the 
result of that comparison is utilized to generate a bit value as part of the signature. 
For example, if the first window of a pair has a larger value than the second 

20 window and the difference exceeds a chosen threshold, the corresponding bit in the ~ 
signature is assigned a digital value of zero. Alternatively, if the second window 
has a value larger than the first window by the chosen threshold, the bit value of 
the signature is set to one. The values of the windows can be determined using 
characteristics such as gray values, edge points, frequencies, variance of gray 
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The transform representation is provided to a signature extractor module 26 
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* values, etc. The ch characteristic may be varied depeno^Pon the needs of a 
particular situation. 

More details regarding the currently most preferred method of extracting a 
signature from the image data are given in United States Patent No. 5,915,038, the 
5 teaching of which is incorporated into this specification by reference. Other 
signature extraction or identification methods may be used according to the needs 
of a particular situation. Given this description, those skilled in the art will be able 
to choose the signature extraction strategy that best suits their needs. 

Once the digital signature is extracted, it is provided, along with the 
10 transform representation of the image, to a signature embeddor module 28. The 
digital signature preferably is coded in a secret manner and embedded into the 
transform representation of the image. The signature embeddor module 28 
preferably accesses high frequency coefficients in the transform representation of 
the image and assigns a new value to those coefficients that corresponds to the 
15 values of the digital signature bits. 

Once the coded signature is embedded as desired, the image signal is 
handled by a signal processor 30 according to the needs of a particular situation. 
For example, the signal processor 30 could place the image information into 
memory or transmit it to a second location, for example. 
20 It should be noted that although individual modules are illustrated in Figure " 

1 for discussion purposes, this invention is not limited to an arrangement with that 
number of separate components or devices. Those having the benefit of this 
description will realize that hardware, software and various combinations of the 
two can be utilized for performing the functions performed by the modules 
25 schematically shown. 
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chart diasram 40 that illustrates 



ferred method of 



this invention. At 42, a preferably block-based transform procedure is performed 
to generate a transform representation of the image that includes high frequency 
coefficients. At 44, the image signature is extracted based upon the image data. 

5 At 46, the high frequency coefficients within the transform representation are 
identified. At 48, new coefficient values are assigned to the high frequency 
coefficients that correspond to a coded version of the digital signature. The steps 
illustrated in Figure 2 preferably are performed at a sending location, for example. 
At a receiving location, the embedded, coded signature information is accessed or 

10 extracted from the high frequency coefficients and deciphered to determine the 
embedded digital signature of the received image. That signature is compared with 
a signature determined directly from the image. If the two signatures match, the 
received signal is verified and the image content can be considered authentic. 



15 coded signature information. A digital signature 50 is illustrated having 8 bits and 
is in a binary format so that each bit has a zero value or a one value. An image 52 
is schematically illustrated having a plurality of blocks A through H. Each block 
includes at least one high frequency coefficient schematically illustrated at 54, 56, 
58, 60, 62, 64, 66 and 68, respectively. Of course, the schematic illustration in 

20 Figure 3 greatly simplifies a transform representation of an image as known in the 
art. 

A code preferably is used to embed information into the transform 
representation of the image that corresponds to the digital signature. In one 
example, an even value number is embedded into a high frequency coefficient of a 
25 block to correspond to a zero value bit in the signature 50. Similarly, an odd 
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' value number is assil^l to a high frequency coefficient tha^irresponds to a bit 

in the signature having a binary value of one. As shown in Figure 3, the first bit 
of the signature 50 is a zero and the high frequency coefficient 54 is assigned an 
even value. Each of the high frequency coefficients illustrated correspond to one 
5 bit in the signature. It follows then, given the strategy mentioned above, that the 
high frequency coefficient 56 has an even value as do the high frequency 
coefficients 60 and 64. Each of the high frequency coefficients that correspond to 
a bit in the signature having a one value are assigned an odd number value. 
Accordingly, the high frequency coefficients 58, 62, 66 and 68 each have an odd 

10 number value. 

Utilizing the high frequency coefficients in the transform representation of 
the image provides a convenient place to embed the coded signature information. 
The high frequency coefficients are typically associated with high frequency 
components in an image signal, which are typically considered noise and do not 

15 affect the perceived display of an image signal. Accordingly, altering the contents 
of the high frequency coefficients to include coded signature information is 
believed to not have any appreciable impact on the quality of the image that is 
ultimately provided. 

In the example of Figures 3, one bit per block is utilized to embed the 

20 coded signature information. It is preferred that at least one bit per block is" 
utilized. Up to 64 bits (i.e., coefficients) per block can be used. It is important 
not to change the DC values of the transform representation of the image. 
Therefore, a minimum of one and a maximum of 64 high frequency coefficients 
are preferred for embedding the coded signature information. 
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Alternative cfl^E; strategies can be used. For exaifl(^ multiple number 
values can be used in combination to correspond to each bit in the digital 
signature. Additionally, the digital signature can be repeated in the event that it 
contains less bits than there are blocks in a signature, for example. Having the 
5 coded signature repeated throughout an image provides a more robust arrangement 
that renders it more difficult for an unauthorized individual to alter the image 
signal. 

Given this description, those skilled in the art will be able to develop the 
necessary software code to program a computer or microcontroller or to develop 
10 dedicated circuitry to perform the functions described above. Similarly, those 
having the benefit of this description will be able to choose from among 
commercially available components to develop a system that performs according to 
this description. 

The preceding description is exemplary rather than limiting in nature. 
15 Variations and modifications to the disclosed embodiments may become apparent 
to those skilled in the art that do not necessarily depart from the spirit and basis of 
this invention. The scope of legal protection given to this invention can only be 
determined by studying the following claims. 
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